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Abstract 

The Kalman filter is extensively used for state estimation for lin- 
ear systems under Gaussian noise. When non-Gaussian Levy noise is 
present, the conventional Kalman filter may fail to be effective due to 
the faet that the non-Gaussian Levy noise may have infinite variance. 
A modified Kalman filter for linear systems with non-Gaussian Levy 
noise is devised. It works effectively with reasonable computational 
cost. Simulation results are presented to illustrate this non-Gaussian 
filtering method. 
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1 Introduction and statement of the problem 

The Kalman filter, or the Kalman filtering method, provides an efficient 
way to estimate the state of a linear dynamical system subject to Gaussian 
white noise [5l [U [7|. It has been widely used in applications such as target 
tracking, parameter estimation, control theory, signal processing, and other 
data assimilation tasks. 

The Kalman filter requires the noise be either Gaussian or with finite 
variance [5l [6], and thus it is not applicable to linear systems with non- 
Gaussian noise of infinite variance. As non-Gaussian Levy noise with infinite 
variance exists ubiquitously [101 E], it is desirable to study the Kalman 
filtering problems under Levy noise. Very little work has been done for this 
issue. Breton and Musiela [1] presented a scheme for Kalman filtering with 
noise of infinite variance, while assuming the contribution of the jumps are 
exactly known. The filter in is nonlinear and recursive, and thus may 
greatly limit its application in practice. Ahn and Feldman [I] proposed to 
minimize the difference between the true state and the filtered observation 
in the L'^-norm. However, as pointed in [9], this method does not really 
address the Kalman filtering problem which consists of combining forecasts 
and observations. The method in [9] focuses on large errors and has a robust 
performance but high computational cost due to the matrix diagonalization 
and the operation of the fractional power in each step. This may also be an 
obstacle for real-time implementation in practical applications. Note that 
in practice, each iteration step must be completed during every sampling 
period, and it is greatly desirable to make the algorithm as fast as possible. 

In this paper, we will present an algorithm, which has the similar com- 
putational cost as that of the Kalman filter, but can be applied to linear 
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systems with non-Gaussian Levy noise of infinite variance. 

We consider the following discrete time model with the state equation 



(1) 



and the observation equation 




where x^, an n-by-1 vector, is the state variable, and z^, an m-by-1 vector, 
is the measurement (or observation) variable, represents the modeling 
error noise, the measurement error noise, and and are n-by-n and 
m-by-n matrices, respectively. We only consider the cases where is a 
Gaussian noise, and is a non-Gaussian Levy noise. 

This paper is arranged as follows. In section 2, the usual Kalman filter 
is briefiy reviewed. The proposed modified Kalman filter is presented in 
section 3. A simulation example is provided in Section 4 to illustrate the 
effectiveness of the modified Kalman filter. 

2 Review of the conventional Kalman filter 

A derivation of the Kalman filter is briefiy reviewed in this section. Some 
equations and ideas presented in this section will be used to present our 
proposed modified Kalman filter in the next section. Derivations of the 
Kalman filter can be found in many references [5l[6l[7]. 

Consider the model as given in ([1]) and ([2]) . The Kalman filtering assumes 
that both the modeling error noise and the measurement disturbance 
are Gaussian with the following covariance matrix. 




Qfc, for i = k, 



(3) 



for i ^ k. 
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Rfc, for i = k, 

(4) 



0, for i ^ k. 



Let Xfc be the priori estimate, which is the estimate of given zq, zi, 
• • • , Zfc_i, and let be the posterior estimate, which is the estimate of x^. 
given Zq, zi, • • • , z^. It is known that 

^{xfc} = E{xk} (5) 

and 

Xfc+i = FfcXfc, (6) 

where E{-} represents expectation and is from ([1]). 

The Kahnan filter assumes that the posterior estimate is expressed as 
the prior estimate corrected by the measurement data, 

Xfc = Xfc + Kfc (zfc - HfcXfe) , (7) 

for some n-hy-m matrix K^. (so called Kalman gain). Note that H^, is from 
([2]). The Kalman gain is solved by minimizing E [(x^ — x^)^]. Note 
that 

E [(xfc - Xfc)^(x,, - Xfc)] = Tr{Pfc}, (8) 

where Tr{-} represents the trace operator, and the n-by-n covariance matrix 
Pfc is defined as follows 

Pfc = £;[(xfc-ife)(xfe-ifc)^] . (9) 

Define 

Pfc = S[(xfc-Xfc)(xfc-Xfc)^] . (10) 
It follows from ([3]), (g]), dH) and ([TO]) that 

Pfc+i = FfcPfcF^ + Qfc. (11) 
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Substituting ([7]) into ([9]), we get 



Pfc = (I - KfcHfc)Pfc(I - KkUkf + KfcRfcK^. 



(12) 



It follows from ([ED that 



d 



Tr{Pk} 



2(H - KPkf + 2Kfc(HfcPfcHi' + R^). 



(13) 



dKk 



Solve Kfc by letting aKT^^iPfc) = 0' get 



Kfc = P,.HnHfcPfcH^ + Rfc) 



-1 



(14) 



By (jl2p and (jl4p . P^ can be rewritten as 



Pfc = (I-KfcHfc)Pfc. 



(15) 



Combining ([6]), ()14p and (llSp . we thus have the conventional Kalman filter. 
This algorithm is shown in Figure [H 

3 A modified Kalman filter 

It is known that the discrete time Gaussian white noise can be approximated 
by the increments of Brownian motion per time step, and the non-Gaussian 
Levy noise can be approximated by the increments of the corresponding 
Levy process per time step. By Levy-Ito theorem [2], a Levy process can be 
decomposed into the sum of a Gaussian process and a pure jump process. It 
is shown in [3] that the small jumps of a Levy process can be approximated 
by a Gaussian process. Therefore, we can approximately regard a Levy 
process as combination of a Gaussian process and a process with big jumps. 
For more information about decomposition of a Levy processes, see [21 [2]. 
These results enable us to decompose a non-Gaussian Levy noise into a 
Gaussian white noise plus some extremely large values. 

In our proposed filtering method, we convert the original Levy noise into 
a Gaussian white noise by clipping off its extremely large values. 
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Let Vfc represent the clipped version of the Levy measurement distur- 
bance Vfc, and let z^. represent the corresponding clipped observation. Thus 

Zfc = HfcXfc + Vfc. (16) 

In practice, since the measurement noise, v^, is unknown, we propose to clip 
the observation instead of in a component-wise way by the following 
operation: 

E,H^M + C-sign(z^-E,H^M) if K-E,i^^\>C, 

,4 if K-Ejii]fn\<c, 

(17) 

where C is some positive threshold value, z^ and represent the z-th com- 
ponents of the vectors z^ and x^, respectively, and ^^•H^'-'x^ is the i-th 
component of the vector H^Xfe. Note that C is determined by the statistical 
properties of the measurement noise v^. Replacing the observation value z^ 
in ([7]) with its clipped value, we get 

Xfc = Xfc + Kfc (zfc - HfcXfc) . (18) 

Repeating the same procedure in Section 2 to solve the Kalman gain by 
minimizing -E{(xfc — x^)^}, we get 

Kfc = PfcHnHfcPfcH^ + Rfc)-\ (19) 

where is the covariance matrix of defined as 

iik = E{vkvl}. (20) 

In the conventional Kalman filter, and are assumed to be known, 
and as noted in [6], it is often a difficult task to estimate the covariance 
matrices and R^. 
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In the modified Kalman filter here, we only assume Q/c is known and 
suggest Rfe be estimated as follows. It follows from (flUj) and (fT7|) that 

=E I [(zfc - HfcXfc) - Hfc(xfc - Xfc)] [(zfc - HfcXfc) - Hfc(xfc - Xfc)]^| 
=(zfc - H,,Xfc)(zfc - HfcXfc)"^ + HfcPfcH^. (21) 

In deriving the last identity of ()2ip . we have used the fact that z^ and x^ 
are known values and 

E{{ik- HfcXfc)(xfc - ^kful} = (zfc - HfcXfc)E{(xfc - 5ikf}Ul = 0. 

(22) 

With ([2T]) . ([19]) can be rewritten as 

Kfc = PfcHn2.HfcPfcH^ + ifc)-i, (23) 

where 

R-fc = (zfc - HfeXfc)(zfc - HfcXfc)'^. (24) 

Combining equations (fT7|) . ([TH]) . (f23|) . and (pl|) . we obtain the modified 
Kalman filter, as shown graphically in Figure [2j 

Comparing with the conventional Kalman filter, the proposed filter has 
an moderately increased computational cost due to the following two opera- 
tions: i) the clipping operation for z^; ii) the computation of Rk- The former 
operation is implemented by IF-EISE sentence, and the latter is simply a 
vector- vector outer product. 

4 Simulation results 

Consider a particle moving in the plane at some velocity subject to random 
perturbations in its trajectory. The new position at time A: + 1 is equal to 
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the old position at time k plus the velocity and noise. The model can be 
expressed in form of and ([2]) as 



(25) 
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(26) 



where {x\, x\) is the position at time A;, u\, uj, the velocity, w\, w\, w^, 

'4 



and wf are all Gaussian white noises with zero mean and unit variance, and 



vj, and i)| are independent and identically distributed noises consist of two 
components: i) a symmetric a-stable Levy noises with the index of stability 
a = 1.3 and the scale parameter c = 10 (see [8]); ii) a Gaussian white noise 
with variance of 5. Since the measurement noises, and vf,, have infinite 
variances, the conventional Kalman filter can not be applied to estimate the 
position and x'^. So we apply the modified Kalman filter proposed in the 
previous section. 



Take = 10, = 10, = 1, 



0, and we apply the modified 



Kalman filtering method to estimate and x|. In the simulation, the 
initial a priori estimate of the state, (xj, Xq), is set to be equal to the 
observation at time 0, its error covariance, Pq, is set to be unit matrix, and 
the threshold value C is set to be 40. The simulation results are shown in 
Figure [3l where the estimate position error, ER, defined by 



ER, = ^{zl - xlY + {zl - xlr, 
is compared with the observed position error, OR, defined by 



(27) 



OR, = ,/{xl-xlr + {xl-xly. 



(28) 
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The results in Figure [3] are calculated by averaging 10, 000 times of sim- 
ulations. It is seen from this figure that the position estimation error is 
significantly improved by using our modified Kalman filter. 

In the simulation, we select C by the method of trial and error, and it is 
found that the threshold value C is not very picky and C can vary from 30 to 
100 without significant effects on the performance of the modified Kalman 
filter. Determining the optimal C, which is crucial for the modified Kalman 
filter, deserves further research and will be left for our future work. 
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k = k + l 
L 



Enter Priori estimate xq 
and its error covariance Pq 



Compute Kalman gain 



:PiH[(HiPtH[ + ] 



Project ahead 

Pfc+i = FfcPfcF[ + Qt 



Z0,zi, 



Compute error covariance for 
updated estimate 

Pfc = (I - KfcHfc)Pfc 



Update estimate with 
measurement 

Xfc = Xfc + Kk (zfc - HfcXfc) 

n 



i7 



xo,xi, 



Figure 1: The usual Kalman filtering algorithm 
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Enter Priori estimate xq 
and its error covariance Po 



k = k + l 



Compute Kalman gain 



Kt — PfcHj (2 ■ HfcPfcHj + Rfc) 



Project aliead 





Update estimate witli measurement 








i) if I4-i:,h;^x 


>c, 






if K-^,^^^ 


<c, 




= Xj. + Kfc (zfc - Hj.Xfc) 







Compute error covariance for 
updated estimate 

= (I - Kj,Hj,)Pfc 



X0,Xi,' 



Figure 2: The modified Kalman filtering algorithm 
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Figure 3: The error of the modified Kalman filtering algorithm 
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